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Abstract 

In  this  paper,  we  present  an  algorithm  for  computing  time-periodic 
feedback  solutions  for  nonholonomic  motion  planning  with  collision- 
avoidance.  For  a  first-order  Lie  bracket  system,  we  begin  by  comput- 
ing a  holonomic  collision-free  path  using  the  potential  field  method. 
Then,  we  compute  a  nonholonomic  path  approximating  the  collision- 
free  path  within  a  predetermined  bound.  For  this  we  first  solve  for 
extended  inputs  of  an  extended  system  using  Lie  bracket  completion 
vectors.  We  then  use  averaging  techniques  to  calculate  the  asymptotic 
trajectory  of  the  nonholonomic  system  under  application  of  a  family  of 
highly-oscillatory  inputs.  Comparing  the  limiting  trajectories  with  the 
extended  system  we  obtain  a  system  of  nonlinear  equations  from  which 
the  desired  admissible  control  inputs  can  be  solved.  For  higher-order 
Lie  bracket  systems  we  use  multi-scale  averaging  and  apply  recursively 
the  algorithm  for  first-order  Lie  bracket  systems.  Based  on  averag- 
ing techniques  we  also  provide  error  bounds  between  a  nonholonomic 
system  and  its  averaged  system. 
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1      Introduction 

Nonholonomic  Motion  Planning  (NMP)  is  the  study  of  path  planning  for 
a  robotic  system  subject  to  either  nonholonomic  constraints,  e.g.,  rolling 
constraint,  or  nonintegrable  conservation  laws,  e.g.,  conservation  of  an- 
gular momentum.  NMP  arises  in  dextrous  manipulation  with  a  multifin- 
gered  robotic  hand  ([FGL91b],  [Li89]  and  [MS90]),  path  planning  for  mobile 
robots([Lau92]  and  [JC89]),  control  of  nonholonomic  actuators  ([Bro88]), 
and  reconfiguration  of  a  space  structure  using  internal  motion  ([FGL91b], 
[Kri90],  [NM90]  and  [PD90]). 

The  problem  of  nonholonomic  motion  planning  can  be  stated  as  follows: 

Problem  1.1    (TMonholonomic  Motion  Planning  Problem:^  Let  Q  be 

a  n-dimensional  configuration  space  of  a  robotic  system,  xq  and  xj  two  given 
initial  and  final  configurations,  B{x)  £  Sf^nxm  ^  m-dimensional  completely 
nonholonomic  distribution}  (or  constraints)  which  translates  into  a  system 
of  differential  equations  of  the  form 

X  =  bi{x)ui  + \-bm{x)Um     =     B(x)u  (1) 

and 

C,ix)<0,i=\,---l  (2) 

a  set  of  position  constraints  for  collision  avoidance.  Compute  a  set  of  in- 
put u{t)  G  S'l'",  t  G  [0,T],  perhaps  of  optimal  cost,  such  that  the  resulting 
trajectory  x{t)  e  Q,t  £  [0,T],  is  collision-free  and  links  xj  to  Xq. 

Research  in  nonholonomic  motion  planning  has  e.xpanded  recently.  For 
example,  Brockett  ([Bro81]  and  [BD91])  and  Murray  and  Sastry  ([MS90] 


'This  is  equivalent  to  the  nonlinear  control  system  (1)  being  controllable. 
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and  [MS92])  studied  analytic  solutions  of  a  family  of  canonical  or  chained 
systems  using  Fourier  analysis  and  optimal  control.  They  applied  feedback 
transformation  and  linearization  techniques  to  reduce  a  general  system  to 
the  canonical  or  chained  form.  Lafferriere  and  Sussmann  ([LS90])  studied 
analytic  solutions  of  a  class  of  nilpotent  or  nilpotenizable  systems.  Their  iter- 
ative algorithm  can  also  produce  approximate  solutions  for  non-nilpotent  or 
non-nilpotentizable  systems.  In  ([Mon89],  [Mon92],  [BM90]  and  [RMB92]), 
optimal  solutions  and  feedback  control  for  coupled  rigid-body  systems  or 
nonholonomic  systems  with  drift  were  studied.  Based  on  Ritz  approxima- 
tion theory,  Fernandes,  Gurvits  and  Li  ([FGL91b]  and  [FGL91a])  gave  a  nu- 
merical algorithm  for  NMP  along  with  some  interesting  simulation  results. 
In  [SL91],  Sussmann  and  Liu  presented  a  new  approach  to  nonholonomic 
motion  planning  with  collision-avoidance. 

It  is  clear  that  the  approaches  taken  by  ([Bro81],  [BD91],  [MS90],  [MS92], 
[LS90]  and  [FGL91b])  can  be  classified  as  open-loop.  While  there  are  certain 
advantages  associated  with  each  of  these  open-loop  approaches,  an  open-loop 
approach  is  less  likely  to  produce  solutions  which  are  robust  with  respect 
to  modeling  uncertainties  and  senoring  errors,  as  compared  with  a  feedback 
approach.  However,  as  Brockett  pointed  out  ([Bro83])  that  smooth,  time- 
independent  feedbacks  do  not  exist  in  general  for  a  nonholonomic  motion 
planning  system. 

In  view  of  Brockett's  result  and  the  fact  that  a  typical  robotic  task  de- 
mands real-time  generation  of  nonholonomic  paths,  we  will  present  in  this 
paper  a  new  algorithm  for  computing  collision-free,  smooth  time-periodic 
feedback  solutions  for  NMP  systems.  The  algorithm  is  efficient  and  re- 
quires only  ordinary  computational  tools  for  its  implementation.  In  addition, 
through  the  use  of  averaging  techniques  we  will  offer  a  geometrical  interpre- 
tation to  the  approach  used  in  ([SL91]).  Here,  the  different  time-scales  of 
averaging  arise  because  motion  in  the  directions  of  the  control  vector  fields 
is  much  faster  than  that  in  the  directions  of  the  Lie-bracket  vector  fields. 
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Furthermore,  if  a  system  under  consideration  is  of  higher  Lie-bracket  or- 
der, then  multi-scale  averaging  results  and  the  feedback  algorithm  becomes 
recursive. 

The  paper  is  organized  as  follows:  In  Section  2.1,  we  present  the  algo- 
rithm for  a  first-order  Lie  bracket  system  along  with  a  simple  example.  In 
Section  2.2,  we  generalize  the  algorithm  to  higher-order  Lie  bracket  systems. 
In  Section  2.3,  we  apply  averaging  techniques  to  prove  two  important  theo- 
rems used  in  the  feedback  algorithm  and  give  estimates  for  error  bounds.  In 
Section  3,  we  provide  motivations  for  the  control  inputs  used  in  the  feedback 
algorithm  by  studying  the  control  of  a  class  of  nonholonomic  systems.  In 
Section  3.2,  we  present  some  controllability  results  of  a  linearized  nonholo- 
nomic system  around  a  nominal  trajectory.  In  Appendix  A,  we  compare 
some  of  our  results  with  that  of  Coron's  and  establish  a  negative  result  on 
the  existence  of  smooth  time-periodic  feedbacks  for  exponential  stability.  In 
Appendix  B,  we  study  analytic  solutions  for  generalized  Brockett  system. 

2      Averaging  and  the  Feedback  Algorithm 

In  this  section,  we  describe  an  algorithm  that  computes  time-periodic  feed- 
back solutions  for  NMP.  In  contrast  to  the  Basis  Algorithm  ([FGLDlb]),  this 
algorithm  will  give  solutions  which  are 

•  collision-free  and 

•  robust  with  respect  to  modeling  uncertainties  and  sensoring  errors. 

Furthermore,  only  ordinary  computational  tools  will  be  needed  for  its  im- 
plementation. 

We  will  first  consider  the  case  of  first-order  Lie  bracket  systems  and  then 
generalize  the  results  to  higher-order  Lie  bracket  systems. 
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2.1      The  First-Order  Lie  Bracket  Case 

Consider  the  following  controllable  nonholonomic  system 

X  =  bi(x)ui  +  b2{x)u2  +  ■  ■  ■  +  bmix)um  =  B(x)u,    16  3?"  (3) 

with  initial  and  final  configurations  xo,xj  G  3?",(n  >  m).  The  system  is 
said  to  be  a  first-order  Lie  bracket  system  if  only  first-order  Lie  bracket 
operations  are  necessary  to  generate  the  controllability  Lie  algebra.  For 
example,  let  /  =  m{m  -  l)/2  then  the  rank  of  the  following  Lie  algebra 
completion  matrix 

{6i(i),62(x),  •  ■■bm{x),  ci(x),  •  ■■ci{x)}  i  C{x) 
is  n,  Vx  G  3?",  where 

c.(x)  =  [6,(.),M.)]=^6,(x)-^M:^) 

denotes  the  Lie  bracket  vector  field  of  bj  and  bk. 

The  algorithm  that  computes  time-periodic  feedback  solutions  for  system 
(3)  has  four  steps  and  is  described  below.  We  leave  the  proof  of  correctness 
to  Section  2.3. 

Algorithm  2.1   (Feedback  Algorithm  for  Ist-Order  Systems) 

Step  1  Computing  Collision-free  Holonomic  Path:  Use  holonomic  motion 
planning  techniques  (see,  e.g.,  [SS86],  [Can88],  [YapST],  [Kod87]  and 
[RimOO])  to  construct  a  collision-free  (holonomic)  dynamical  system 

y  =  9iy),  2/(0)  =  lo  G  K"  (4) 

such  that  the  goal  configuration,  xj,  subject  to  some  topological  con- 
siderations, is  essentially  the  global  attractor.  For  example,  if  we  follow 
the  potential  field  method  as  in  ([Kod87]  and  [Rim90])  then  g{y)  is  the 
gradient  vector  field  of  some  navigation  function. 
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Other  than  practical  considerations  dynamical  system  (4)  can  be  cho- 
sen arbitrary.  Our  objective  is  to  find  for  system  (3)  time-periodic 
feedbacks  of  the  form 

u  =  u(x,  t,€) 

where  e  is  a  small  parameter,  such  that  the  C-norm  of  the  trajectory 
error  between  the  holonomic  system  (4)  and  the  nonholonomic  system 
(3)  goes  to  zero  as  e  — *  0, 

lim||a;  -  2/||c[o,Tl  ^  ^ 

Here,  T  is  fixed  and  the  C— norm  of  a  continuous  function  y{t)  G 
3?",f  G  [0,T],is  defined  by 

l|2/llc[o,T]  =   max  |y(/)| 

Step  2  Compute  extended  inputs  v  =  (ui,U25  •  •  ■Vm+i)'^  from  the  following 
system  of  linear  equations 

{bu---bm,ci,---ci)v  =  C{y)v  =  g(y) 

Since  the  Lie  bracket  completion  matrix  C{y)  has  rank  n,  the  solution 
is  given  by 

V  =  C^iCC^r'giy)  =  C^giy) 

Thus,  the  collision-free  holonomic  path  satisfies  the  following  system 
of  differential  equations 

y  =  biVi  +  b2V2  + h  bmVm  +  ClUm-l-l   +  '  '  '  +  ClV^  +  l  (5) 

with  initial  condition  t/(0)  =  xq. 
Step  3  Let  the  control  input  of  the  nonholonomic  system  (3)  be  of  the  form 

u]  =  Q.(x)  +  y?^/3/(x)sin(j</€)  +  7/(x)cos(iVf)  (6) 
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where  e  is  a  small  parameter. 

Clearly,  u'  is  time-periodic  feedback.  It  becomes  highly  oscillatory 
as  e  — ►  0.  The  asymptotic  behavior  of  system  (.3)  under  applica- 
tion of  control  input  (6)  can  be  computed  using  averaging  techniques 
([Arn78]).  Following  the  results  of  Section  2.3  (see  also  [GurOl])  the 
asymptotic  trajectory  satisfies  a  differential  equation  of  the  form 


!  =  1  Kj 


(7) 


where 


771  (  - 

S,  =  a.  +  ^  ^  ((V/3f ,  6,)7t  -  (V7f ,  b,)(3^)  sgn{j  -  i)- 

\ 


J  =  l  k=l 


Skew(7y,j)  = 


/         0  7712         7713 

-^12  0  7/23 

-T?i3     -■r?23      0 


v 


=  EKA7^-)r 


fc=i 


/ 


fc  \T 


and  the  A  (wedge)  product  of  two  vectors  x,y  £  3l"  gives  a  n  x  tz 
skew-symmetric  matrix 

T  T 

X  A  y  —  xy     —  yx    . 

V/  denotes  the  gradient  vector  field  of  the  function  /. 

Step  4  Solving  for  the  Desirable  Inputs:  Equating  the  coefficients  of  system 

(5)  with  that  of  (7)  yield  a  system  of  nonlinear  equations 

'      -  1 


Y,{(3'^l')T  =  Ske^^■{r^,,)         (8) 


k:=l 


m       I 


III  i  -. 

"•  +  E  E  ((^^.-  ^jhj  -  (^7.',  h)P^)   sgn(j  -  Oi  =  ^.,        (9) 


J  =  l  k=l 
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where  i  =  l,---m.    Solving  for  (a,/3,7)  from  Eqs.    (8)  and  (9)  gives 
the  desirable  inputs  to  the  nonholonomic  system. 

Remark  2.1  (1)  Estimates  of  the  trajectory  errors  between  the  holonomic 
system  and  the  nonholonomic  system  can  be  found  in  Section  2.3.  (2)  The 
algorithm  also  applies  when  both  systems  are  non- autonomous,  i.e., 

X     =     B{x,t)u, 

y   =   9{y,t) 

In  this  case,  the  Lie  bracket  and  gradient  operations  are  performed  for  fixed 
time  t,  and  the  control  input  has  the  form 

u,  =  a,{x,  t)  +  \j\Y.(il{x.  t)  sin(^)  +  fi{x,t)  cos(^). 

D 


Example  2.1  We  use  the  rolling  disk  example  to  illustrate  the  feedback  al- 
gorithm. Let  {x,y)  be  the  contact  location,  4>  the  angle  and  (ui,U2)  the 
steering  and  rolling  velocity,  respectively,  of  a  rolling  disk.  Then,  the  equa- 
tions describing  the  constraint  are  given  by  (see  [FGLOlb]) 


"  </>■ 

"  1 ' 

0 

X 

= 

0 

Wl  + 

cos<?;> 

.  y . 

0 

sin  (p 

"2  =    ^l^'l  +  ^2^2 


(10) 


It  is  clear  that  this  is  a  first-order  Lie  bracket  system  as  the  completion 

matrix 

/  1  0             0 

C  =  ibi,b2,[bi,b2])  =  0  coscp  -sin(;6 

y  0  sin4>  cos(ii> 

is  nonsingular  over  the  configuration  space. 

Assuming  that  the  holonomic  system  is  given  by  the  following  exponen- 
tially stable  system 

z  =  -z  (11) 


Averaging  and  the  Feedback  Algorithm    The  First-Order  Lie  BracA'et  Case 


We  want  to  construct  inputs  for  system  (10)  whose  asymptotic  behavior  as 
€  — >  0  is  given  by  that  of  (11). 

From  Step  2,  the  extended  inputs  are  found  to  be 


(^'1 

-4> 

-<f> 

i'2 
V3 

=  c'^icc'^)-^ 

—  X 

-y 

= 

-(x  cos(f>  +  7/ sin  <j)) 
X  sin(^  —  y  coscj) 

Choose  the  following  forms  of  the  control  inputs 

U-,     =     Oi  +  \  -pi  cos  - 

V  e  e 

/2^     .     t 
Un     =     02  +  \   -P2  Sin  - 

V  f  € 

where  we  have  set  7,'s  to  zero  for  simplicity. 

Thus,  the  system  of  nonlinear  equations  from  Steps  3  and  4  have  the 
form 


ai-/32(V/3i,62) 

a2  +  /3i(V/32,6i) 

M2 

It  is  not  difRcuIt  to  check  that 


-<f> 

—  {x  cos(f)  +  7/sin  (f)) 

X  sin  4>  —  y  cos  (p 


(12) 


f3i      =      l,Qi  =  -4> 

(^2      =      X  s'llKf)  —  y  COS  <l> 

Q2     =     —2{x  COS  4>  +  y  s'm  (f>) 

constitute  a  set  of  solution  to  Eq.    (12).   Thus,  the  time-periodic  feedback 
solutions  are 

ui     ^     -4>-\- J- cos{-)  =  Ui{(t>,t,e) 

[2  t 

U2     =     — 2(a;  cos(^  +  2/sin(^)  +  w -(x  sin<?f)  —  2/cos^)sin(-) 


=       U2{<l>,X,y,t,€) 
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Figure  1:  Simulated  trajectories  for  (a)  e  =  0.0001  and  (b)  e  =  0.015625. 

The  solution  grows  out  of  bound  as  e  — >  0.  To  avoid  unbounded  control,  we 
can  use  symmetry  of  a  driftless  system  to  rescale  the  control  input 

Ui{4>,t,€)     =     y/€Ui{<p,t^/e,e) 

U2     =     y/eu2{<t>,x,y,ty/e,e) 

Let  x{t)  G  3ff^  be  the  corresponding  nonholonomic  trajectory,  we  have  that 

x{ty/€)  =  x(t) 

Figure  1  show  simulation  results  for  two  different  values  of  e  and  scaled 
control  inputs  Uj.  D 

Remark  2.2  (1)  The  feedback  input  constructed  above  does  not  vanish  at 
the  origin,  as  Ui(0,/)  ^  0,  while  the  control  input  in  [Cor91]  is  identically 
zero  at  the  origin.  (2)  It  is  impossible  to  find  ((3i,P2)  which  are  differentiable 
at  the  origin  and  satisfy  y9i(0)  =  /J2(0)  =  0.  If  so,  from  the  equation 

P1P2  =  X  sin  (/>  -  2/  cos  <j> 


10 
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we  have  that 

|W2)lo  =  /32|^  +  /3i|f  =  -cosO  =  -l 

resulting  in  a  contradiction.  L 1 

It  is  interesting  to  note  that  solutions  of  the  nonholonomic  system  con- 
verge to  a  small  attractor  containing  the  origin.  Denote  by  B  a  ball  of  the 
origin.  Then,  solutions  of  the  nonholonomic  system  have  the  form 

x{l)  =  €-'x{0)  +  \/lG(x,  /),    t  e  [0,  27r] 

for  all  xo  €  B,  where  G(x,t)  is  bounded.  For  sufficiently  small  c,  a:(27r) 
is  also  in  B.  We  can  use  a-(27r)  as  the  new  initial  condition  and  apply  the 
same  set  of  control  inputs  to  the  system.  Consequently,  trajectories  of  the 
nonholnomic  system  converge  to  a  subset  of  a  ball  centered  at  the  origin 
with  radius 

\/e       max       G(x,t). 

xeS,(€[0,27r] 

2.2      The  Higher-Order  Lie  Bracket  Case 

To  compute  time-periodic  feedback  solutions  for  higher-order  Lie  bracket 
systems  we  introduce  multiple  small  parameters  and  use  a  recursive  algo- 
rithm. 

Consider  a  r"'-order  Lie  bracket  s\'stem, 

i  =  biui  +  ■  ■  ■  +  bmUm,     X  6  3?"  (13) 

together  with  the  following  holonomic  system 

y  =  9iy),    2/(0)  =  x(0)  G  3?"  (11) 

and  time  interval  [0,27r]. 

Algorithm  2.2  (Recursive  Algorithm  for  Higher-Order  Systems) 


11 
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Step  1   Compute  a  Lie  bracket  completion  matrix  for  the  system 

C{x)  =  {61,  •  •  •6,„,  [b„  bj],  ■  ■■[b„ ,  [b,„l  ■  •,  b.J  •  •  •]}  (15) 

■^ ^ ' 

r 

Step  2  Compute  the  extended  inputs  by  the  formula 

(Vir  •  •1'm,Vm  +  l,-  ■  ■Vm  +  rj)'^  =  C  ■  gix). 

where  C"  =  C^(CC-^)~^  is  the  generalized  inverse  of  C  and  77  is  the 
number  of  entries  of  C{x)  less  m. 

Step  3  Let  r  >  1  be  the  order  of  C{x),  we  form  another  matrix  Ci{x)  of 
order  no  more  than  (r  —  1)  as  follows.  First,  rearrange  the  entries  of 
C{x)  so  that 

C{x)^{C,{x),Ch{x)}  (16) 

where  Ci{x)  consists  of  vectors  of  order  strictly  less  than  r  and  Ckix) 
consists  of  the  highest  order  vectors.  Second,  let  Ci{x)  be  a  minimal 
set  of  vector  fields  such  that  its  order  is  strictly  less  than  r  and  any 
vector  in  Ch{x)  can  be  obtained  by  a  single  Lie  bracket  operation  on 
the  entries  of  C/(x)  and  C;(x).  Finally,  set 

Ciix)  =  {Ciix),  Ciix)}  =  {br,  ■  ■  -bmJu  •  •  -/s,  ,ffi,  •  •  -gs,].        (17) 

" V '   " V ' 

<?l(l)  C,(x) 

It  is  clear  from  the  above  construction  that,  using  Algorithm  2.1,  tra- 
jectories of  the  system  defined  by  C(x)  can  be  approximated  by  that 
of  the  system  defined  by  Ci{x). 

Step  4  Introduce  a  small  parameter  fj  and  use  Algorithm  2.1  to  compute 
the  coefficients  of  the  following  input  functions 


7,(3:,0+^^al.,i(a-,0sin(-)  +  /?j^,i(x,0cos(-), 

1      ^  kt  kt 

H,ix,  t)+  —fYI  '^I-,2(^'  0  sin(  — )  +  /3i,2(^'  0  cos(— ), 
V  f  k=i  ^1  ^1 
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,kt. 


kt^ 


<'     =     ^^al.,3(a;,0sin(  — )  +  /Ji.,3(x,0cos(  — ) 
V^  k=i  ^1  '1 

where  the  index  i  runs  from  1  to  m  for  the  first  equation,  1  to  s-[  for 

the  second  equation  and  1  to  $2  for  the  last  equation,  and  p  is  defined 

as  follows:   First,  let  A'  be  the  minimal  set  of  vector  fields  such  that 

any  element  of  Ck{x)  is  the  Lie  bracket  vector  field  of  two  vectors  in 

A'.  Then,  denote  by  p  the  number  of  entries  of  A',  and  we  have 

p  =  p(p-l)/2. 

Step  5  If  the  Lie  bracket  order  of  C((x)  is  no  less  than  1,  then  replace  C{x) 
with  Ci{x)  and  repeat  Step  3  and  4,  using  another  small  parameter 
and  the  extended  inputs  computed  previously. 

Note  that  the  asymptotic  expression  for  the  error  function  in  the  /.-""-step 
of  the  above  recursive  algorithm  can  be  shown  to  be  (see  Section  2.3) 

Ao     -     0, 
A.+i     -     v/?IT7(CiA',  +  e2-C3^''C2A',')  (18) 


Ko     =     max{||/,(x)||,||G,(x)||}, 

i.k.T 


1 


^a+1       — 


and  the  accumulated  error  is 


C^Ka, 


(19) 


A  =  ||a;  -  2/||c[o,2^]  =  Ai  +  •  •  •  +  A,. 

In  order  for  the  nonholonomic  trajectories  to  converge  to  that  of  the  nominal 
system,  the  f^'s  have  to  be  chosen  so  that  A  is  within  an  acceptable  bound. 

Example  2.2  The  constraint  equations  of  a  ball  rolling  on  a  plane  have  the 
form 

0      1         r     -1 

secx\  0 

x=       —  sin  xs  Ui  +       —  cos  a"5 
—  C0SX5  sin  15 

—ianx\  0 


U2  =  b\(x)u\  +  b2{x)u-. 
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Let  63  =  [bi,b2],  b.i  -  [61,  [&i,ft2]]  =  [''i,''3]  and  65  =  [62,63],  it  is  not  difficult 
to  clieck  that  (soc,  e.g.,  [LC90]) 

C(x)  =  {61,62,63,64,65} 

defines  a  Lie-bracket  completion  of  the  system  and  the  Lie-bracket  order  is 
2. 

Initially,  Step  3  of  the  algorithm  gives 

Ci{x)  =  {61,62,63} 

Ck{x)  =  {b,,bs}, 
Ci{x)  is  empty  and  p  =  3.  I— I 

Example  2.3   Consider  another  2-inputs  and  3-states  system  of  the  form 

i  =  6i(a;)ui -I- 62(x)u2  (20) 

Assume  that  the  Lie-bracket  completion  matrix  has  the  form 

C(x)  =  {6i,62,[[6i,62],[6i,[6i.62]]]} 

In  other  words,  this  is  an  order  3  system. 
Initially,  we  have  that 

0(x)  =  {61,62},  C,(i)  =  {[[6i,62].[6,,[6i,62]]]} 

C',(a:)  =  {[6i,62],[6i,[6i,62]]} 
and  p  =  1.  Thus,  the  nominal  system  is  given  by 

y  =  bivi  +  62r2  +  [[6i,62],[6i,[6i,62]]]t'3  (21) 

and  the  nonholonomic  system  by 

X  =  6iu'i  -|-62U'2  +  [6i,62]u)3-|-  [61,  [61, 62]] W4  (22) 
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Applying  Step  4  of  the  algorithm  we  can  find  the  u;,'s  in  terms  of  the  u.'s. 


U'2       =       V2 
W3      = 


UM 


—  cos(— )t;3 


Then,  the  new  nominal  system  is  given  by  (22)  while  the  nonholonomic 
system,  by 

X  =  biri  +  627-2  +  [bi,b2]r3.  (23) 

Introduce  another  small  parameter  £2  and  solving  for  the  r[s  in  terms  of  the 
w[s  we  get 


'•1      =      ■"'!  +  W  — COS(  — )  =  1)1  +  ./— cos(  — ) 

V  f 2         €2  V  f 2  (2 

T2       =       ■U'2  =   U2 

,       /^         .   '   ^ 

^3     =     U"3  +  \/  — cos(  — )u;4 

V  f2  f2 


2         .  <  ^  /2  2/2  i 


Finally,  with  nominal  system  given  by  (23)  and  the  nonholonomic  system 
given  by  (20)  the  true  control  inputs  are  found  to  be 

"1     =     t^i  +  W  — cos(  — )+ ,/— cos(  — ) 

V  f 2  f  2  V  f3  f3 

[^  .    ,  t     (   pi  t  fT         </T         / 

"2     =     i'2  + ,/  — sin(  — )     ./— cos(  — )r3+ ,/— cos(  — ),/— sin(  — ) 

V  f3  f3      VV^l  fl  V  ^2  f2     V  *^1  <^1 

n 
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2.3      Averaging  and  Asymptotic  Behaviour 

III  this  section,  we  use  averaging  techniques  to  compute  asymptotic  be- 
haviour of  a  nonholonomic  system  under  application  of  some  highly  oscilla- 
tory inputs. 

Consider  the  following  nonholonomic  system 

m 

x  =  ^b,{x)ul  (24) 

!  =  1 

with  control  input  of  the  form 

ul  =  u,{t)  +  -^u,{1,e)  (25) 

v^ 

where  6  =  t/e,  and  the  function  u,-  is  periodic  in  6  with  period  2;r,  and  has 

zero  average 

/      u,{t,9)de  =  0.  (26) 

We  can  identify  6  as  the  fast  variable,  and  {x,t)  the  slow  variables.  Using 
the  Averaging  Theorem  ([Arn78],  pp.  293-297)  we  can,  for  small  enough 
e,  replace  the  above  system  with  an  "averaged"  system  for  which  the  fast 
variable  is  eliminated.  Moreover,  the  averaged  system  serves  as  a  good 
approximation  of  system  (24). 

Theorem  2.1    For  sufficiently  small  e ,  the  trajectory  of  system  (24)  is  bounded 
by  solution  of  the  following  system 


(27) 


1 

i  =  ^b,iz)u,  +  —J2[bi,bj]uij,    z{0)  =  x(0)  =  a;o 

in  the  sense  that 

Ik  -  2||c[o,2^]  =  A,  <  Ai,,  +  A2,£ 
where 

i'i,j  =  j    J  u,{t,T)uj{t,e)dTde  (28) 

and  (Ai,j,  A2,f)  are  parameters  which  tend  to  zero  as  e  —'  Q. 
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In  other  words,  system  (27)  defines  the  asymptotic  behaviour  of  system 
(24)  as  e  ^  0. 

Proof.  The  derivatives  of  the  slow  variables  with  respect  to  the  fast  variable 
are  seen  to  be 

I  m  m 

^■'  =  ^  =  fE^'(^)"'(0  + v^E^'(^)"'(<'^)         (29) 
t'  =  ( 

Introduce  new  variable  y  G  5i"  by 

X  =  y  +  V^My^i,^)  +  eMy,t,G)  +  ■  ■  ■  (30) 

where  the  function  (4>i,(t>2)  are  27r— periodic  in  9  and  are  chosen  so  that  y 
satisfies  a  simpler  differential  equation 

y'  =  %  =  '  (/i(2/,  0  +  Vefiiy,  0  +  ■  ■  •)  (31) 

We  can  find  the  functions  {4>i,4>2-,  f\,  f2,  •  •  •)  by  first  differentiating  (30) 
with  respect  to  6, 

I  d<l>i    .       d(f>i       d(l>i .        ,  dSo   ,       dd)2       dSo , 

=         /-^<^l  d<f>2  3/2  ^-^l     .      7d(l>2 

^    09   ^     06   ^  Ot    ^       Oi    ^"' 

+     (l  +  ^^  +  f^)(f/i(2/,0  +  e'/V2(y,0  + •••)  +  ••■  (32) 

and  then  computing  tlie  Taylor  scries  expansion  of  (29)  using  (30) 

m  m 

^'     =     fE'''(y)"'(<)  +  v/?E6,(t/)ii.(f,^) 

1  =  1  1  =  1 

1  =  1  t=l      '^    i' 

(33) 
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where 

71 

b,  =  Y^b'^Ck, 
fc=i 

and  {e/:}5J_i  '^  ^'^^  canonical  basis  of  3?". 

Finally,  equating  the  coefficients  of  e^/^  from  Eqs.  (32)  and  (33)  we  have 

that 

^  =  f2b,iy)u,(t,9)  (34) 

1=1 

The  solution  of  Eq.  (31)  is  given  by 

My,t:0)  =  y2b,{y)  /  u,it,T)dT  +  4>iiy,t). 

Note  that  4>iiy,t,0)  is  27r-periodic  in  6  because  of  (26). 
Equating  the  coefficients  of  e  we  have  that 

Y^b,{y)u,{t)  +  Y,j^4>iU,--^^My,t)  (35) 

1=1  1=1     ^ 

Integrating  both  sides  of  (35)  over  27r  and  taking  into  account  that  f\{yA) 
is  independent  of  6  yield 

m 

1=1 

1       "^       /•2Jr   n/,.  f  "^  r^  _  \ 

+     ^EX      ^«.(<,^)IX:6,y^    u,(^r)rfr  +  0l(r/,/)^/^ 

=     ^6,(2/)«,(0+:rEE  V'W       /    ^jit,r)dTu,{t,e)dd 
~{  l-K  "--"y  Oy      Jo     Jo 

m  J 

=    ^6.(y)ii,(0+:57Ef^-'M^. 
where 


27r  .    . 
1=1  i<j 


r2ir     rB 


Uij=  /    u,{t,T)u,{t,e)dTde  (36) 

Jo     Jo 
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In  the  above  derivation,  we  have  made  use  of  the  facts  that  <t>2  is  27r-periodic 
in  0,  and  Ut{t,6)  has  zero  average  (26).  The  last  equality  follows  from 
integration  by  parts. 

Using  the  formula  for  fi(y,  t)  we  have  for  </)2  that 


dy 


t-\l 


which  gives 

[^  f  ""   db  \  _ 

Equating  the  coefficients  of  e-'/^  we  have  that 

i:i*.s.+i:|^*A«,9)+i:E(|5^*..*.)  =  «!'.')+^ 

Integrating  the  above  equation  with  respect  to  6  from  0  to  27r  yields 

-     ^f  (E  ^.(f  *.*.)«   -^)..        (37, 

We  choose  ^iiy,t)  to  be 

/•27r    '"  y-2;r 

My,t)  =   -  Tb.iy)  U.{t,T)dTd8 

Jo         ,  JO 

so  that  4>i{y,t,0)  has  zero  average, 

,2^ 

/      4>i{y,t,e)de  =  0 
Jo 

Using  the  above  property  of  4>i  in  Eq.  (37)  we  have 

1        /■2ir    f    ^     f)},  m       n  ^2;  t  \ 

/^(»-')= ^/„  (i:|*3^.('.«)+i:i:'M|i*„^,w-) 
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Finally,  we  have  the  following  form  for  the  derivative  of  y  with  respect 
to  the  slow  variable  t 

m  1 

=     Y^b.iy)u,  +  —Y^[b„b,]i^,,,  +  e'/'My,t)  +  0{c)        (38) 
and 

a-(0  =  y  +  \^4>i  +  ((t>2  +  ••■ 

with  x(0)  =  2/(0)  =  xq. 

Define  the  averaged  system  by 

m  -■ 

z  =  ^  6.(2)iZi(t)  +  —  Y,[b„  6,>.j,    z(0)  =  y(0)  =  x(0).  (39) 

ZTT    .       . 
1=1  1<J 

The  error  between  the  averaged  system  and  the  original  system  can  be  com- 
puted using  techniques  from  ([Arn78])  and  is  given  by 

A,  =     sup    \\x{t)  -  z{t)\\  <  Ai,,  +  A2.. 

<6[0,27r] 

where 

Al,,  =   \\X  -  y\\c[0,2rr],    ^2  =   Ik  -  2/|lc[0,27r] 

For  sufficiently  small  c,  we  also  have 

Ai,e     <     Vc\\M  +  0{e) 

A2,.     <     v/^(e'^'VA')||/2|lc[o,2.] 


where 


■(^  ,,db,  .^-^    d[b,.b. 


'J  I 


^     9y  ^        dy 

and  all  norms  are  the  maximum  norm  defined  in  some  neighborhood  of  z{i). 

D 
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In  view  of  Eq.    (28)  the  problem  is  to  find,  for  given  i'i,j,{i  <  j),  '2n- 
periodic  function  Uj{t,6)  which  lias  zero  average  and  satisfies 

^  f  \,(t,e)  j  u,{t,T)dTde^  :^^.,,(0  (40) 

2tv  Jo  Jo  ^tt 

The  solution  to  the  problem,  using  Fourier  method  of  separation  of  variables, 

has  the  form 

k 

u,{t,e)  =  ^4(<)sinpe  +  /?;(0cospe  (41) 

p=i 

Define 

It  is  easy  to  check,  through  direct  integration,  that 

''    1 
Skew(i/,j)  =  TT  ^  -/3p  A  ap  (42) 

p=i  ^ 
where 

0p  Aap  =  /3pQp  -  OpPj. 

In  other  words,  we  have  to  solve  the  following /aciorfra/fon  problem:  For  a 

given  skew-symmetric  matrix  S,  find  f3p,ap  such  that 

k 
5  -  ^  /3p  A  Qp  (43) 

In  the  case  k  =  m(m  —  l)/2,  the  solution  is  given  by 

Skew(r.,,j)=       J2      ('Ajf.  Acj) 

l<i<j<m 

Remark  2.3  Here  the  elements  of  5,  /3p  and  Op  belong  to  some  commutative 
algebra  A'  over  3i.  In  our  context  it  is  the  functional  algebra.  In  other  words, 
we  are  solving  nonholonomic  motion  planning  problem  for  the  following 
infinite  dimensional  system 

X     =     u,    x(0)  =  x(2x), 

S     =     X  A  u,    5(27r)  -  5(0)  =  Skew(;/,,j) 
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using  finite  Fourier  representation  for  the  control  input 

u  =  y^  ttp  sin  pt  +  0p  cos  pt 

V 

This  motivates  one  to  study  the  canonical  systems  introduced  by  R.  Brock- 
ett  ([BroSl]).  In  fact,  the  same  ideas  can  be  applied  to  the  family  of  chained 
systems  of  higher  Lie  bracket  orders,  with  states  and  control  inputs  belong- 
ing to  an  arbitrary  commutative  algebra  over  §ff .  For  example,  the  algorithm 
given  in  [MS90]  works  for  any  commutative  algebra. 

If  the  algebra  is  the  reals  or  the  complex  numbers,  we  can  easily  find  out 
the  minimal  k  solving  Eq.  (43),  namely 

min(^')  =  rank(5)/2 

and  the  solution  is  given  by  the  so-called  symplectic  decomposition  of  5.  In 
the  general  case  the  problem  is  difficult  to  solve. 

Proposition  2.1   Assume  the  following  input  to  system  (29) 

m(m-l)/2  ^  ^ 

u,  =  u,(x)-t-       ^       Q-'(x)sin(A:-)-f /3f(a:)cos(^--)  (44) 

fc=i  ^  ^ 

then  the  asymptotic  trajectory  is  defined  by  solution  of  system  (J,5) 

m 

i  =  ^^6,(x)+      Y.     [''nM'^.,,,    z{Q)  =  x{Q)  (45) 

t=l  l<t<j<m 


where 


m    m(m-l)/2 

<5,  =  u,{x)  -}-  ^       Y.       ['yPl^j)^)  -  (^«'>^.)/?')  ^'Ori{j  -  i)- 

J  =  l  k=\ 


m(m-l)/2 

Skeuiu,,,)=       Y.       (^'^"')/t 


and 
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Proof.  Apply  the  control  input  (-14)  to  system  (29)  we  have 

m  ry"»(m-l)/2  ^^  ^_^ 

i  =  ^G,(x)+J-       J2       Rk{x)sin{  —  )  +  Qk{x)cos{  —  } 
1=1  ^      *.=1  ^  ^ 

where 

Gi{x)     =     6,(a:)u,(a:) 

m 

R,{x)     =     ^6.(x)af(x) 
t=i 

771 

Qfc(x)     -     ;^6,(x)^.'^(x) 
»=i 

The  desired  result  follows  from  the  proof  of  Theorem  2.1  and  the  fact  that 
[6ia(x),  b2p{x)]  =  al3[bub2]  +  62(V/3,  i^i)  -  6i{Va,62>. 

D 
3      Controllability  and  Holonomy 

In  this  section  we  provide  the  motivation  for  using  the  control  input  in 
Algorithm  2.1. 

Consider  a  system  of  the  form 

X2      =      U2 

is       =       f\(x\,X2)ul-\-  f2{xi,X2)U2 

where  {xi,X2,X2Y  £   "^^^    Assume  that  /i,/2  are  smooth  functions  and 
define  by 

ff(a-i,a-2    =  T. T^— • 

oil       ax2 

If  there  exists  a  ball  B^  6  3?^  such  that  5(3-1,12)  #  0  for  all  (ii,X2)  inside  the 

ball  and  zero  outside  the  ball,  then  the  system  is  controllable  but  not  locally- 

locally  controllable  (see,  e.g.,  [HH70]).  To  see  this,  let  xq  —  [x\,X2,x%)  and 
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xj  =  [x{,x{,xl)  be  two  given  points  and  (ii,i2)  G  3l^  a  point  such  that 
(7(fi,i'2)  /  0.  Suppose  that  17  is  a  closed  ball  in  B^  containing  (ii,i2)  with 
boundary  5fl,  then  by  Green's  Theorem  we  have  that 

/     h{xx,X2)dxi  +  f2{xi,X2)dx2=   //  g{xi,X2)dxidx2. 
Jsn  J  Jn 


Figure  2:  Holonomy  of  a  control  path  in  3C^. 

A  trajectory  which  links  xq  to  xj  is  shown  in  Figure  2,  where  control 
input  u{t)  £  5i*,<  £  [0,Ti],  is  chosen  to  steer  the  system  from  (x°,X2)  to 
(x(,X2).  Then,  17  is  chosen  so  that 


n  =  \  x 


-  \J 


j      fiUidt  +  f2U2di\  (  g{xi,X2)dxidx2] 


is  an  integer  (could  be  negative)  and  control  input  v{t)  £  3?-^,/  £  [7'i,T],  is 
chosen  to  cause  the  system  to  encircle  Cl  n  times,  clockwise  if  n  is  negative. 
It  is  quite  clear  that  the  system  is  not  locally-locally  controllable  for  a  point 
lying  outside  the  B^  ball.  In  order  for  it  to  be  locally-locally  controllable 
the  set  {{xi,  X2)  £  5i^,£f(xi,  2:2)  7^  0}  has  to  be  dense  in  3i^. 

Generalizing  from  the  above  example,  we  have  the  following  result. 

Theorem  3.1    Consider  a  nonlinear  control  system  of  the  form 


X     =     u 

y     =     f{x)u 


(46) 
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where  {{x,y),x  6  3i",2/  €  W"}  Js  llie  state,  u  G  Si"  the  control  input,  and 
f[x)  =  [fi{x), .  .  .,  fnix)]  a  collection  of  x -dependent  C^  vector  fields.  The 
system  is  controllable  if  and  only  if  the  span  of 

is  equal  to  Si"*,  where 

'•^       dxj       dxi 
In  order  to  prove  Theorem  3.1,  we  need  the  following  lemma. 

Lemma  3.1  (1)  Let  c  :  [0, 1]  — >■  3f'",c(0)  =  0,  be  a  C^  curve  and  associate 
with  c  the  following  grid 

k 

G{c)  =  {yeri^,y  =  Yl  ".'^(«.), ".  e  z,  <,  e  [o,  i],  i  e  [i,k],  [<k<oo} 
1=1 

we  claim  that  G{c)  is  in  fact  a  linear  subspace  of^"^. 
(2)  Moreover, 

is  a  subspace  of  Si™  of  dimension  at  least  k/2,  where  Z  denotes  the  set  of 
integers  and  N  the  set  of  nonnegative  integers. 

Remark  3.1  The  lemma  does  not  hold  for  oo-dimensional  space.  Consider, 
for  example,  the  case  c(t)  £  L2[0, 1]  such  that 

for  ^  7^  0  and  c(0)  =  0.  Then,  c{t)  =  c{t^)  is  C^  and  G{c)  is  not  a  linear 
subspace,  because  for  any  /i  6  G{c}  we  have  that 

fi{0)  €  N. 

D 
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Proof  of  Lemma  3.1.  Since 
so  we  have  that 


=     /    c'{T)dT 

Jo 
G(c)Cspaii{c'(r),^e  [0,1]}  =  L 


We  will  show  that 

G(c)  =  L  (47) 

Let  /  be  the  dimension  of  L  and  pick  /  points  {'r,}'_j  such  that 

{c'(r.),ie[i,m 

forms  a  basis  of  L. 

Define  a  map  C  :  3i'  — ►  L  by 


C(^i,...,^,)  =  ^c(r.  +  ^,) 


1=1 
The  directional  derivative  of  C  is 

dC.  ,.    , 

^k=o  =  c(r,) 

and  thus  the  Jacobian  of  C  is 

[c'(ri),...,c'(r,)]^Z) 

It  is  clear  that  D  is  nonsingular  and  by  the  rank  Theorem,  for  sufficiently 
small  6.  C(Bs{0))  has  nonempty  interior  in  L,  where  Bs{0)  is  an  open-ball 
of  radius  6.  Thus,  by  construction  we  have  that 

ImiO  C  G{c) 

On  the  other  hand,  G{c)  has  the  additional  properties  that 

G(c)  +  G{c)  C  Gic) 
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and 

kGic)  C  Gic),   \/k  e  Z. 

Using  these  facts  we  conclude  that  G{c)  =  L.  U 

Proof  of  Theorem  3.1.  To  show  that  the  condition  is  necessary,  suppose 
that 

Span{r7,j(x),x  6  3ff",l  <  i,j  <  n}  /  Jf'" 

Then,  there  exists  a  vector  e  £  3i'"  such  that 

{e,gij)  =  0,  VI  <  i,j  <  n 
Consider  the  differential  equation  for  (y,  e) 

n  n 

{y,ey  =  {f(x)u,e)  =  ^(/,(x),e)i,  =  ^f,{x)x„ 


1=1  1=1 


where /.(x)  =  Er=i//(^K- 


Note  that  /,  :  5i"  — -  Ji  is  a  C^  function.  It  is  clear  that 

In  other  words,  the  integrability  condition  is  satisfied  and  there  exists  a  C^ 
function  q  such  that 

Therefore,  for  any  a-(O)  =  a-(l)  we  have  that 

(2/(0),e)  =  (2/(l),e) 

This  contradicts  the  assumption  that  the  system  is  controllable. 

To  show  that  the  system  is  controllable  at  (xo,j/o)i  choose  m  points 
{ijt}"=i  such  that 

{0>kjk(^k),  1  <  k  <  m,\  <  ikjk  <  n]  =  F 
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forms  a  basis  of  Sf".  We  will  construct  a  curve  that  takes  the  system  from 
(xo,yo)  to  an  arbitrary  state  (x,y)  as  follows: 

First,  denote  by  Sk(i)  a  simple  closed  curve  based  at  if.  and  lying  on 
the  x,^.  —  Xji^  plane,  e.g.,  circle  or  square, 

Skie)     =     {{x^,...,x"'),x'  =  x\,ij^  ikjk^x"'  e[x\^,x[^ +e], 
x'"  €  [xi'',xi'  +  e]} 

Define  a  primitive  curve  M{k,e,A^)  in  the  x  or  the  control  space  to  be  a 
curve  with  the  following  three  seqments: 

1.  The  first  segment  links  xq  to  Xk- 

2.  The  second  segment  traverses  Sk{e)  N  times,  clockwise  if  A^  >  0  and 
counter  clockwise  if  A"^  <  0. 

3.  The  last  segment  is  the  negative  of  segment  1,  and  thus  links  Xk  back 

to  Xq. 

Let  Ck  be  a  curve  of  Ji™  such  that 

J  JSk{c) 

Then,  by  Green's  Theorem,  the  final  destination  of  traversing  the  primitive 
curve  M{k,  e,  TV)  is 

(xo,  2/0  +  rick{e)) 

Therefore,  if  we  use  all  possible  motions  of  M(k,  c,  A'^)  we  can  achieve  points 
of  the  form 

m 

{(2:0, 2/):  2/ €  2/o  +  ^G(ci)} 
fc=i 

By  Lemma  3.1, 

m 
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is  a  linear  subspace  of  S?™,  which  contains  the  set 

B  =  {gi,j,{xk)e^  +  oie^),  l<k<m} 
But,  by  assumption  B  forms  a  basis  of  S?*"  for  sufficiently  small  e.  Therefore, 

m 
A;=l 

and 

m 

fc=i 

D 

Using  the  constructive  procedure  in  the  proof  of  Theorem  3.1,  we  can 
obtain  an  upper  bound  for  the  optimal  control  input. 

Proposition  3.1    Consider  the  system 

X     =     u 

y   =    fix)u 

with  boundary  conditions  x{0)  =  x{l)  —  xq,  y{0)  =  yo  and  y{l)  —  yj.   Here 
{x,y)  G  3v"  X  S?"*.  Assume  that  there  exist  m  points  {^fc}^i  such  that 

{Sikjki^k),  1  <  ^-  <  m,  1  <  ikjk  <  n} 

forms  a  basis  of  3?'".     Then  the  optimal  control  input,   which  is  piecewise 
smooth,  is  bounded  above  by 

/o 
where  C\ ,  C2  and  C2  are  constants. 


1: 


\u{t)fdt  <  C\\\yf  -  yof  f  C2  J2  Iko  -  x^f  +  C3  j  (48) 


Proof.  From  the  proof  of  Theorem  3.1,  we  know  that  there  exists  a  ball  of 
radius  a,  B„(0),  which  lies  in  the  set 

|f:c,.(4)-Ci-(e^),  0<e^<f-|D5.(0). 
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Therefore,  we  can  express 

yj  -yo  =  ^i[Yl  ^'^•('^fc)  ~  ^''■(^^■' 

where 


fc=i 


(49) 


ri  =  [\\yj-yo\\/cT]+h  fU[o,f]. 

and  [||j//  -  yoW/cr]  denotes  the  integer  part  of  \\yf  -  yoU/cr. 

First,  construct  control  input  u{t),  t  G  [0, 1],  so  that  the  resulting  x-trajectory 
is  the  composition  of  the  following  primitive  motions 

M(l,ei,l),---A/(m,em,l) 

For  example,  the  associated  control  input  for  M(l,ei,  1)  has  the  form 

3m(xi  -  xo),  t  e  [0,3^], 


-3m(ii-a;o),  t  6  (all' ml 


where 


and 


w  =  (0,---M.,(O,0---u,j(O,0,---0r 


Wm(0 


1    31  "Ji    =    < 


0,  /e(i4], 

The  corresponding  cost  is  computed  to  be 


f  0,  /e[o,i]. 


fii  *  ^  U' 2]' 
0,  «e(|,f], 


i: 


(u,  u)dt  =  - — ||io  -  •^ill^  +  3mei 


and  the  total  cost  is 


^1  =  ^T.W'^o-x.f  +  im.Y^fl 


3m 

Then,  using  the  above  control  input  and  time  scaling  to  construct  new  con- 
trol input  so  that  the  resulting  a;-trajectory  is  the  composition  of  the  prim- 
itive motions 

M(l,fi,7?),---3/(m,e„,T/) 
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Obviously,  the  final  input  cost  is  given  by 


v'h 


and  from  which  we  have 

|2    /    2      ""  "• 

3m 


,,,,,fe^       2^ll^^_^_l|3^^^_^^, 


1=1  1=1 

D 

Proposition  3.2    Under  the  same  conditions  as  in  Proposition  3.1,  if  we 
restrict  that 

Mt)\\<Q 

and  assume  that  \\yj-yo\\  is  sufficiently  large,  then  the  optimal  control  input 

hp  -   /    (u,  u)dt 
Jo 

is  bounded  by  the  following  inequalities 

CiWy/  -  2/o|P  <  lop  <  C2\\yf  -  yof  (50) 

where  Ci  and  C2  are  some  constants. 

Proof.  Because  of  Proposition  3.1  we  only  need  to  show  the  lower  bound. 
The  following  inequalities  follow  from  Schwartz  inequality 


dt\\ 

1/2    /    ,1  s   1/2 


WVf  -  2/0II     =     II  /    /(x)u 
Jo 

]« 11/(^)11  •(/'{«,»>*) 


<      max 

11x11 


Therefore,  we  have  that 

> 

(max||^ll<n  ||/(x)||) 


/j.,.)..  >  ^_^LzMl__  ^  c>ii,,  -  ,o|i^ 
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D 

From  the  proof  of  Proposition  3.1,  we  observe  that  a  system  of  nonlin- 
ear equations,  namely  that  defined  by  Eq.  (49),  needs  to  be  solved  if  we 
use  inputs  of  bounded  quadratic  cost.  It  is,  however,  possible  to  obtain 
asymptotic  control  input  by  solving  only  a  system  of  linear  equations  if  we 
allow  the  cost  to  be  unbounded  quadratic  functions.  We  present  such  an 
algorithm  below  for  system  of  the  form 

X    =    u,  X  e^"-, 

y     =     f{x)u,    2/G3?'" 
with  boundary  conditions 

i-(0)  =  x(l)  =  a:o,    2/(1)- 2/(0)  =  <^. 

Algorithm  3.1  Step  1   Choose  a  small  e  >  0. 

Step  2   Compute  the  vector  z  =  (zi,-  ■  -^mV  by  solving  the  following  sys- 
tem of  linear  equations 

e'^Dz  =  6 

where 

step  3  Use  the  control  input  in  the  proof  of  Proposition  3.1  to  cause  the 
i-trajectory  to  follow  the  following  primitive  motions 

Mil,e,  [-'i]),  ^/(2,  e,  [.-2]),  •  •  -Mim,  e,  [z,]) 

where  [-;]  denotes  the  closest  integer  to^-^.. 

It  is  easy  to  see  that  the  contribution  of  the  above  primitive  motions 

in  the  2/-space  has  the  form 


fc=i 
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where 


J  J  SkU) 


J^ik 


The  error  term  is  bounded  by 

||^-_^ll<|l^-_^-||  +  ||6-_^||  (51) 

and 


k=i 

The  first  term  in  (51)  is  in  the  order  of  €^, 

\\l-l\\r.e\ 

The  second  term  is  in  the  order  of  1, 

1-8     =     {e^D  +  0{e^))€-^D-U-6 

=     {{D  +  0{l))D-'  -  1)6^0(1). 

However,  if  f(x)  is  twice  continuously  differentiable,  then  it  is  possible 
to  show  that  Ck{()  =  git,jk^^  +  Oie'^)  and 

\\S-S\\^e.  (52) 

For  example,  if  the  primitive  motions,  M{k,  e,  [zk])i  are  circles  of  radius 
f  with  time  interval  [0,27r],  then  (52)  holds.  In  this  case,  the  control 

input  has  the  form 

1    .    ,  t  ^   I        ^  t  ,  ,  ^. 

-sin(-r-),-cos(— ).  (53) 

e         e^     e         €^ 

Remark  3.2  The  results  of  the  above  algorithm  provide  the  motivation  for 
using  highly  oscillatory  control  inputs  in  Section  2.  LJ 
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3.1      Controllability  of  Linearized  Nonholonomic  System 

In  this  section,  we  disciiss  linearization  of  a  nonholonomic  system  around  a 
nominal  trajectory  and  controllability  properties  of  the  linearized  system. 
Consider  a  nonholonomic  system  of  the  form 

X  =  Aix)u,    X  e  S",  (54) 

where  u  =  {ui,  ■  ■  ■u,n)'^ ,  and  A  =  (Ai,  ■  •  -Am). 

Let  u  be  a  nominal  control  input  to  system  (54)  and  6u  a  perturbation 
term.  Apply  the  perturbed  control  input  u  =  u  +  Su  to  (54)  and  linearize  the 
system  around  the  nominal  trajectory  x,  we  obtain  the  following  differential 
equation  for  the  linearized  system 

J  /    771        <-^     i  \ 

where 

X  —  X  -\-  8x  -\-  o{\\8x\\) 

Note  that  system  (55)  is  linearized  about  a  nominal  trajectory,  not  about  a 
fixed  point  as  in  usual  practice. 

We  have  the  following  results  for  controllability  of  the  linearized  system. 

Theorem  3.2   Assume  that  the  columns  of  A{x)  are  C^  functions,  and  there 
exist  constants  C  and  B  such  that 

\\A{x)\\<C+B\\x\\ 

then  system  (54)  is  controllable  if  and  only  if  for  every  xq  there  exists  control 
input  u(-)  such  that  the  linearized  system  (55)  is  controllable. 

Remark  3.3    The  above  theorem  is  used  in  [Cor91]  to  construct  smooth, 
time-periodic  feedbacks  for  stabilization  of  system  (54). 
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To  illustrate  Theorem  3.2,  consider  the  the  following  simpler  system 

ii     =     vi 

X2     =      U2  (56) 

y    =    /i(-r)«i+/2(x)u2,  yerr. 

Linearize  the  system  about  a  nominal  trajectory  (iii,U2)  £  ^2[.0, 1],  we  have 
—  ((5a:2)     =     ^U2  (57) 

It  is  easy  to  sec  that  the  linearized  system  is  controllable  if  and  only  if  it  is 

possible  to  reach  from  the  origin  any  state  of  the  form  (0,0,(^!/).  Therefore, 

we  can  assume  that 

/    iuxdt  =   I    Su2dt  =  0 
Jo  Jo 

Integrating  the  third  equation  of  (57)  by  parts  and   using  the  following 
boundary  conditions 

Sx,{0)  =  6x,{l)  =  0,    i=  1,2 
yield 

«i)  =  /'(fA,,  +  M,^,„„w72A,,^M,^w, 

Jo    \axi  axi     )  Jo    Koxo  0x2     J 

+    J  ih{x)6ui  +  f2ix)6u2)dt 

Jo    \axi  dxi     J  Jo    \dx2  dx2     J 

+     j^    (/i(^)^(<5xi)  +  /2(x)^(^a:2))d/ 
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Assuming  for  simplicity  that  («i(<),U2(0)'  ^  €  [0,1],  are  contiiuious  func- 
tions, then  we  have  the  following  criteria  for  controllability  of  the  linearized 
system:  there  exist  <i,  •  •  •<„  G  [0, 1])  such  that 

ul{t,)  +  ulit^)     /     0 

Note  that  we  can  use  the  above  result  to  provide  an  alternative  proof  of 
Theorem  3.1. 
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Appendix  A:  Comparision  with  Coron's  Results 

It  is  worthwhile  to  compare  results  of  this  paper  with  that  of  Coron's 
([CorOl]).  First,  let's  summarize  several  relevant  results  of  this  paper. 
Consider  a  nonholonomic  system  of  the  form 

X  =  bi(x)ui  +  •  •  •bm{x)Um,    ^  6  Jl"  (58) 

and  a  holonomic  system  of  the  form 

Let  /  be  the  Lie-bracket  order  of  (58)  and  fix  a  ball  centered  at  xq  and  of 
radius  S,  B{xo,  6). 

1.  If  g{y,t)  G  C"  for  any  /,  then  there  exists  feedback  solution  Uf^{x,t,€)  £ 
C"'  for  any  t  and  e  such  that 

Ik  -  y||c7[o,27r]  ^  0,  as  e  —  0. 

2.  U  g{y,t)  is  27r-periodic  in  t  and  y{2iT)  £  B{x,a6),  (0  <  q  <  1),  for  any 
y(0) G  B{x,8),  then 

Ik  -  2/llc[o,oo)  ^  0,  as  €  -^  0. 

3.  If  the  holonomic  system  is  exponentially  stable,  i.e., 

||K0-^o||<e-"'||2/(0)-x(0)|| 

for  any  y{0)  G  B{xo,S),  then  there  exists  an  attractor  A^  such  that 

Bist{x,A,)  <  Ce'""^ 

and 

max  lla-o  -  ^||  — *  0,  as  e  ^  0. 
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Recall  tliat,  for  a  first-order  Lie  bracket  system  where  the  nominal  system 
is  given  by  y  =  -y,  the  control  input  has  the  form 

u{x,t,c)  =  a{x)  +  ^--       ^      /3,(a;)sin(-)  +  7,(2;)cos(-) 

which  is  unbounded  as  e  ^  0.    To  avoid  using  unbounded  control  we  can 
rescalc  time  with 

ft  =  y/€u{x,t\/€,e) 

The  trajectory  of  the  system  under  the  application  of  v^,  denoted  by  x(t), 
is  related  to  x{t)  by 

x{t)^x(t^} 

and  the  rate  of  convergence  to  an  attractor  of  radius  ~  •/£  is  e~^^. 

It  is  interesting  to  note  that  a  similar  rate  of  convergence  is  also  ob- 
served in  the  solution  of  Riccati  equation.  Consider  a  discrete-time  Reccati 
equation 

associated  with  solution  of  the  following  system 


x{n  -t-  1)       =       x{n)  +  u{n) 

oo 

min     ^  u{n) 


n=l 


It  is  clear  that  the  solution  P{n)  =  ^^^pL.  —  0  as  n  -*  oo. 
Consider  the  perturbed  equation 


1  +  P{n) 
we  have  P(r?)  —  P  >  0,  where  P  =  €+  -^.  Thus,  the  equation  for  P  is 

P^  -  (P  -  e  =  0 
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which  gives 

Therefore, 


-        e  +  Ve^  +  4e         ^ 

P  = ~  V£. 


P(n)  -  P  ~  i—^f"  ~  e-^N/^". 
1  +  P 

We  would  like  to  ask  the  following  question:  Can  we  have  exponential 
stability  of  the  goal  point  using  the  smooth  time-periodic  feedbacks  given  in 
our  algorithm'!  Note  that  in  order  for  this  to  be  true,  the  control  input  has 
to  satisfy 

u{x,0, e)  =  0 

which  implies  that 

a(0)  =  0,7,(0)  =  0. 

We  will  now  show  that  the  answer  to  the  above  question  is  negative^ 
Recall  the  Gershkovich  inequalities  ([VG88]):  If  a  system  of  the  form  x  = 
B{x)u,  a;  6  3fi",  w  G  3fi'",  is  regular  in  some  neighborhood  of  xq,  r7i(xo)  =  ''n, 
r]i{xo)  is  the  dimension  of  the  space  ¥{  generated  by  Lie  brackets  of  order 
less  than  i.  Denote  by  h(xo)  =  max,{77i  >  t;,_i}  =  m\n{i,r],  —  n}  and  define 
by  4>{i)  =  j  for  r?j_i  <  i  <  r]j  (r/o  =  0),  and  some  local  coordinate  system 
A',  :  B{xo,a)  — ►  Ji  parallelepiped 

IlcA^o)  =  {y£  B{xo,a)  :  \A\{y)  -  A;(a:o)|  <  Ce^^'^}. 

Also  denote  by  Df^{xo)  the  set  of  all  xp  such  that 

X  =  B(x)u, 

x{0)  =  xq,  x{1)  =  xp  and  /q  (u,u)2dt    <  e.  Then  there  are  local  coordinate 
systems  {Xi},  positive  C,  c,  to?  such  that  for  c  <  eo, 

nc,.(xo)  C  D,{xo)  C  nc,,(a-o). 


^This  result  was  first  established  in  [FGL91b]. 
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Notice  that  ||x  -  Xo||.  =  \\x  -  xo\\  is  equivalent  to  ^21=1  I'^ii^)  -  '^ii^o)] 
for  small  enough  ||x  —  xo||- 

We  need  the  following  consequences  of  this  fact:  There  exist  a,(3,t"  such 
that 

1.  For  any  y  E  B{xo,c") 

Jiy)  <  a\\y  -  xoW^ . 

2.  There  exists  a  sequence  ijk  — >  xq,  such  that 

J(yk)>(i\\yk-xo\\^. 

Here  J^(y)  is  the  optimal  cost  for  the  problem  i  =  B{x)u,  x{0)  =  xq, 
ar(l)  =  2/,  J{y)  =  minu /g  {u,  ■u)2dt. 

Delinition  3.1  The  system  x  =  B{x)u  is  (a,g{t)J  stahilizable  at  xq  if  and 
only  if  there  exist  positive  k  and  So  such  that  for  any  y  E  B{xo,  So)  there  is 
a  control  u{t),0  <  t  <  oo,  satisfying  the  following  condition 

X  =  B{x)uit),     i(0)  =  y, 

||t2(t)||  <  k\\x{t)  -  xoW" 

and 

\\x{t)-xo\\  <  \\y-xo\\git),    git)>0. 

Theorem  3.3   .   The  system  is  not  (C,g{t))  stahilizable  at  Xq  '//o°°(5(0)''d^  < 
oo  and  o  >     /  , . 

Proof:  Let  us  pick  a  sequence  yk  — ►  xq,  J{yk)  >  \\\yk  —  loll"''''''  •  The  fol- 
lowing "scaling  symmetry"  is  well-known:  \{  x  —  B{x)u,  x(0)  =  xq,  x{T)  = 
xj,  J{xo,Xf,T)  =  miuu/g  {u,u)2  dt,  then  J{xo,X},T)  =  J(xo,Xf,  1)  (0  < 
T  <  oo). 

Let  us  construct  on  the  time  interval  [0,T  -|-  1]  the  following  control: 
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1.  On  [0,r],  "stabilizing"  control  u{t),  x  =  B{x)u,  x{0)  =  yk- 

2.  On  [T,T  4-  1],  optimal  control  for  the  problem 

2/     =     Biy)u,     y{T)  =  x{T),     y{T  +  1)  =  xo, 
min  /        (u,w)2dt 


lin  /         (w,  «)• 


Then  using  the  Gershkovich  inequality  and  the  property  of  optimality 
we  have 

P\\yk-xo\\^>    <    J{yk) 

<  r\\u{t)\\+j{x{t)) 

Jo 

<     f3  f    \\yk  -  xoW" g{ty +  agiT)^\\yk-xo\\^. 
Jo 

Let  a  >  ^,  J^{g{t)r  dt  =  2?<  cx).  Then 

f3  -  ag{T)  <  kV\\yk  -  xof"^, 

for  any  k  and  T.  Because  for  some  sequence  g{Tm)  — '  0,  we  obtain  /3  <  0, 
a  contradiction.  LJ 
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Appendix  B:  Analytic  Solutions  of  Generalized  Brock- 
ett  System 

In  this  appendix,  we  study  analytic  solutions  for  the  following  generalized 
Brockett  system 

i     =     u, 

2/     =     i^A.vAx  (59) 


\:  =  1  / 

where  x,u  6  3?",  y  G  3fJ'",  A,  e  a?'"^"  for  i  =  1,-  •  -n,  and  boundary  condi- 
tions are 

a:(27r)  =  x{0)  =  0,  y{27r)  -  y(0)  =  S  =  (.5i,  •  .-Smf. 

If  we  use  the  following  Fourier  representation  for  the  control  input 

w.  =  l^apSinp/  + ^6J,cosp^    i=l,---n  (60) 

p=i  p=i 

then  the  cost  to  be  minimized  has  the  form 

/•27r  oo      n 

p=i 1=1 

Integrating  the  second  equation  of  (59)  by  parts  yields 

2ir     "        " 


.jdt 


=      /      ^  y"  .4t(/,;)ifca;jd< 

=     ^{AkiiJ)-  Aj{i,k))  I      XkXjdt 
k<j  •'° 

oo     , 
=       TT  ^  (.4,(f,i)  -  .!,(,•,  ^•))  Y:  -(4^P  -  «'p^') 


Denote  by 
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and  define  a  linear  operator 

D{i,{kJ))  =  Ak{iJ)-A,ii,k),  k  <  i,  (61) 

from  the  space  of  n  X  n  skew-symmetric  matrices,  denoted  by  so{n),  to  3?™. 
Then,  the  expression  for  6  can  be  written  more  compactly  as 

8  =  nD{Yl-XlAX'^).  (62) 

p=i  P 

It  is  not  difficult  to  see  that  the  necessary  and  sufficient  condition  for  con- 
trollability of  system  (59)  is  that  the  linear  operator  D  has  rank  m. 

In  the  case  that  m  —  n{n  -  l)/2  we  can  identify  J?"*  with  50(71).  If  D  is 
the  identity  operator,  then  system  (59)  reduces  to  the  Brockett's  canonical 
system 

X     =     u, 

Z     —     X  A  u,    Z  £  so{n). 

Without  loss  of  generality,  we  will  therefore  consider  optimal  solutions 
for  systems  of  the  form 

X     ^     u,     1(0)  =  x(27r)  G  3?" 

y     =     D{xAu),    2/(27r)  -  2/(0)  =  6  e  S?"*  (63) 

where  the  control  input  has  the  representation  given  by  (60)  and  the  cost 
to  be  minimized  is 

10 


j: 


{u,  u)dt^Y.\\-'^p\\'  +  \\^'> 


p=i 


In  order  to  describe  the  set  of  optimal  solutions  for  the  problem,  we 
introduce  the  following  geometric  construction.  First,  denote  by 

•^"       1-/0 
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the  canonical  symplectic  matrix  of  3fi^",  and  by  Sp(n)  the  set  of  representa- 
tions of  the  form 

n 
1  =  1 

where  {x[,l  <  i  <  n,\  <  I  <  2}  is  an  orthonormal  basis  of  3?2n.    T^gji^ 
Sp{n)  has  the  following  decomposition 

Sp{n)  =  S2n  X  52(„_i)  X  ■  •  •  X  54  X  52  (64) 

where  Sk  is  the  unit  sphere  of  3?''".   Consider,  for  example,  the  case  n  =  2. 
Let  {a-J,x?}2_j  be  an  orthonormal  basis  of  5i''.  Then, 


Jo  =  x]  A  xl  +  xl  /\  X 


and  the  linear  subspace  L,  defined  by 

L,  =   Span{x),i2)2^j 
is  invariant  under  J2,  i.e.,  /^(i.)  C  Li  because 

J2ix])=-X] 

and 

J2(X?)=XJ.  j 

Using  these  properties  we  can  construct  a  decompdsition  of  5p(2)  as  follows: 
First,  pick  an  arbitrary  xj  e  S4  and  compute 

a;}  =  J2XI 
Then,  compute  an  orthogonal  complement  of  Span  {i},!?} 

L2  =  i2''e  Span {i},  0-2}  ^  r^ 
Finally,  pick  an  arbitrary  x^  6  52  and  compute 

X2  ^  J2X2 
As  a  result  we  have  that  5p(2)  =  S4  x  S2. 
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Theorem  3.4   Consider  system  (63).    Suppose  that  there  exists  a  unique 
S  e  so{n)  such  that  S  =  ttD{S)^ 

S  =  Qi  Jn,   ®  02  J„2  •  ■  •  ®  akJni,  ®  0,    Ol    >  02  "  "  "  >   «fc   >   0 

and 

i?"  =  Z„j  ®  Z„2  •  ■  •  ®  Zn,  ®  Ker{S) 

with  Dim{Zn,)  =  Sn;  and  J„,   ari  operator  in  Zn,,  then  the  set  of  optimal 
control  to  system  (63)  has  the  form 

rank{S)/2 


U       = 


y^      A'p  sin  p<  4-  A'p  cos  pt 


/:       n, 


=     ^  ^  A7,j  sin(7?i  +  •  •  •  +  r3i_i  +  ;)  +  A'.^^  cosfni  +  •  •  •  7i,_i  +  j) 

:=1 }=1 


where 


Xl^  =  ya,(ni  +  ---  +  n._i+i)i^^  G  Z„,,  /  =  1,2 
and 

and  </ie  optimal  cost  is  given  by 

''  1  +  n; 

lopt  =  2]^a,(ni  +  •••  +  n,_i  +  — :r-^)n, 

.=1  ^ 

The  above  theorem  is  a  special  case  of  the  following  result. 

Proposition  3.3  Let  5  =  ai  J„j  ®  •  ■  ■  ®  a^Jn^  ®  0,  ai  >  •  •  -at  >  0,  and 
consider  the  following  optimization  problem:  Find  {x},x'^]  such  that  the 
constraint 

oo 

s=y:x]ax] 


1=1 


^This  is  equivalent  to  6  6  lm(D)  and  Ker{D)  =  0. 
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is  satisfied  and  the  cost  function 

oo 

IS  minimized. 

For  any  solution  of  the  problem  we  have  that 

where  {V/^,  l<l  <2,l  <j  <  n,}  C  Sp{n,), 

n-i  + h  n,_i  <  7!  <  73i  + \-  n, 

and  the  optimal  cost  is 

k  711+---  +  TI, 

2E".      E      c-,. 

1  =  1         J  =  ni-\ |-n,_j+l 

To  prove  Proposition  3.3,  we  need  the  following  lemma. 

Lemma  3.2  Let  {x\,3:'i,xl,X2}  be  a  solution  to  the  following  optimization 
problem: 

S  =  x\  A  xl  +  xl  A  xl 

and  cost  function 

Ci  (ikill'  +  \\x\\?)  +  C,  (^\x\  +  \\xl\\')  ,0<C^<C2 

Then, 

\\x]\\^\\x]\\,x'^±x'^for(i,k)jL(jJ) 

Proof  of  Lemma  3.2.  First,  let  us  show  that  x]  ±  x^.  Suppose  that 

^1  =  l^x]  +  7 
Then,  (7,2;^)  =  0,  ||7||  <  ||x^||,  x]  A  xf  =  x]  A  7,  and 

Ci{\\x]\\'  +  \\lf)<C,{\\x]\\'  +  \\x]r) 
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resulting  in  a  contradiction. 

Suppose  that  Q  ==  ||a;Jl|  ^  ||x^||  =  /3.  Then,  we  can  decrease  ||xjl|2  +  |lx?||2 
without  changing  {x}  A  xf)  by  redefining 

x]  =  ^yajSx],^:]  -  \/a^x'- 

It  remains  to  show  that  Xj  ±  X2,k,l  G  {1,2}.  Since 

Rank(5)    <   Rank(x|  A  xl)  +   Rank(a-.^  A  xl)  =  4 

we  can  restrict  the  problem  to  Ji''.  In  this  case, 

5  =  ai  J2  +  02^2)  Oil  >  Oil  >  0. 

There  are  two  possibilities:  (i)  02  =  0,  then  5  =  xAj/and  ||a;|p  =  ||?/|p  =  oi- 
Let  us  show  that  x\  =  x,xl  =  j/  and  x\  =  x\  =  0.  If  not,  then  we  have  that 

Ci||x}||2  +  C2\\x\f  >  Ci  (llxjll^  +  ||,ri|p)  >  aiCi 
But,  if  {x\  —  x,xl  =  y,  X2  =  ^2  =  0)'  ^^^^^  S  =  x\  A  xl  and 

Ci||a:}||2  +  C2||x^|P  =  Ciai 
(ii)  Q2  7^  0.  Let  us  show  that 

c  =  mm{\\x\f,\\xlf)>a2. 

If  not,  then 

\\  [S  -  x] /\  xl)  x\\  >  (02  -  c)\\x\\ 

and  Rank(2-2  A  x^)  =  4,  results  in  a  contradiction. 
Suppose  that 

L2   =  (Span(i2,ar2))"''  ^  Span(x},a:j)  =  Li 

we  can  show  that  in  this  case  c  >  02-   If  not,  for  instance  ||a-}||  =  02,  pick 
y  e  (Span(a;^,a;^))-'-  and  y  ^  Span(a;},a:f).  Then, 

S{y)  =  {x\Ax\)iz),    \\z\\<\\y\\ 
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where  z  is  the  projection  of  y  onto  Lu  and  ||5(y)||  <  a2\\y\\.   But,  for  any 
vector  5  G  aff*  wo  have  ||5(^)||  >  Q2II2II,  a  contradiction. 

Thus,  we  have  the  following  system  of  linear  inequalities  for  Ai=  ||i}||2 

Ai  +  -42  >  «!  +  0:2,  (a2  <  «i )  (because  of  Claim  2) 


A 


and  A2  =  111^112 


and 

Ai  >  Q2,A2  >  ai,Ai  >  /I2 
Consequently,  we  obtain 

C1A2  +  C2A1  >  Ciai  +  C2C12 

which  contradicts  the  optimality  condition.  D 

Claim  1:   Let  .4o  =  Ax  ■{■  A2,  where  A,'s  are  n  x  n  square  matrices  with 
singular  values  {A|,  1  <  2  <  n,  1  <  /  <  2}.  Then, 

/   n  \  I/P  2       /    n  \   '/P 

Claim   2:    Let  5  =  a,Jn,  ®  •  ■  •  ®  q^ J„,  0  0,  5  =   En  ^n  A  x^,  ||4||   = 
||x2||,(a-i,a:2)  =  0,  then 

1  =  1  n 

Proof  of  Proposition  3.3.  First,  let  us  prove  the  existence  of  optimal  solu- 
tions. For  this  consider  a  sequence  of  near-optimal  solutions  {xm}  ^  {xj„„,l  < 
^  <  2},  1  <  m  <  00  such  that 

00 
S  =  Yl^^rn.n  Ax^.n.  min/(x„)  =  inf/(x). 

71=1  ^ 

Because  C,  —  00  the  set  {x^}  is  compact  in  the  strong  topology  of /2.  Thus, 
there  exist  a  subsequence 

Xmt    —  X  =   {x^,  1   <  71   <   OC,  1    <  /  <   2} 
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such  that  5  =  IIn=i  ^'i  ^  ^n  ai^d 

oo 
n=l 

Therefore,  let  x  =  {.t^,  1  <  n  <  oo,  1  <  /  <  2}  be  an  optimal  solution. 
From  the  Lemma  we  have  that 

a;^  =  x2,x^±x-,  for(n,/)/(A;,m), 

and  there  exists  a  map 

k 

7r:[l,En.]-.iV 

:  =  1 

such  that 

M    i||2^  f  0,n^Im{D) 

"    ""         I   ak,  n  =  7r(i),  tij  +  •  •  •  +  n^-i  <  ?'  <  ni  +  •  •  •  +  njt 

To  complete  the  proof,  recall  the  following  inequality:  If  Qi  <  Q2  •  •  •  <  Qm 
and  ^1  >  ^2  ■  ■  ■  ^  ^71)  then  for  any  permutation  tt 

n  n 

t=l  :=1 

D 

Remark  3.4  Let  S  =  Oj Jnj  ®  •  ■  ■  ®  cikJnk  ®  0,  and  Oi  >  Q2  ■  •  ■  >  cvfc  >  0. 
Define  the  following  functional  on  so{n) 

f{S)  =  J2a,i 

i 

If  Ker(Z))  7^  0,  then  the  optimal  control  problem  for  system  (63)  is  equivalent 
to 

min{f{S)\D{S)  =  y{2z)-yiO)] 


52 


REFERENCES REFERENCES 

We  will  give  an  analytic  solution  to  this  problem  for  y  £  9i: 

k 
S  ^Yl  "'(■■^'.'  ^  ^■?)'  "1  >  "2  •  ■  •  >  a/..  >  0  (G5) 

:>1 

and  if  ±  x'^  if  (j,  k)  7^  (j,  /),  ||x]||  =  1, 

k 
min{/(5)  =  ^a,C.},  0  <  Ci  <  ■■■Ck,D{S)  =  6  E  3(f. 

1  =  0 

Note  that  if  D  :  so{n)  — >  Ji  is  a  linear  functional  then  there  exists  unique 
5  €  SO{n)  such  that 

D(S)  =  tT(SS) 

where  tr[S)  stands  for  the  trace  of  S. 
Claim  3:  (1)  Suppose  that 

k 

5  =  ^a,(ij  Axf),    Qi  >  Qf2--- >  Oi  >  0 
i>i 

where  ||a:f||  =  1  and  xf  J.  x'  for  (i,k)  ^  (jj),  and 

k 

1>1 
where  \\zf\\  =  1  and  zf  ±  2]  for  (i,/:)  /  (;,/).  Then, 

k 

t=i 


(2) 

Jt 


2^  a.C,  >  — Ci 


i  =  l 

Proof  of  Claim  3.  First,  note  that 

\triSS)\  =  |^X^a./?,<r((xJ  Ax2)(^]  Az]))i  <  XT^.'J.AO- 
1=1 j=i  1=1 
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where 

=     \{x],z]){x],z])-{x],z]){xlz]))\ 

<     {{x],z]f  +  {x},z]f  +  {xlz]f  +  {xlz^)')/2 

Using  orthonormality  condition,  we  have 

t=l 

Therefore,  {A,_,}  is  a  semibystochastic  matrix  and 

k     k  /  k  \ 

where  tt  is  a  permutation,  7;r  >  OiXTttII''")  ^  1-   But,  for  any  permutation 
TT  we  have  that 

k  k 

t=l  1=1 

To  show  the  second  part,  observe  that 

k  k  y-^  y^  k 

^a.C-     =     ^ai/3,-^  >  min(-i)^a,-^.- 


Proposition  3.4  Suppose  that 

5  =  /?i  J„,  ®  •  •  ■  ®  PkJn,  0  0,    I3i>(52>--->f3k>0£  soin) 
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and 

3^"  =  Z„,  ©•••e2„,  e  A'er(5). 

Then,  the  set  of  optimal  solutions  of  problem  (65)  has  the  form 
||-(ZA-5(Z)),llZl|  =  l,Z€Zn,| 

and 

min/(5)=^Ci 

Pi 

The  proof  is  a  direct  application  of  Claim  3. 

Remark  3.5  Proposition  3.3  is  correct  even  if  C,  -/-  oo.  Necessary  and  suf- 
ficient condition  for  the  existence  of  solutions  is:  There  exist  C'^(i),  •  •  'CTr(k) 
such  that 

0<C,(i)  <  •••<a(fc)  <C„,7i>  1 

where  A:  =  RaTtk{S)/2. 

Claim  4:  Consider  optimal  control  of  the  following  system 

X  =  B(x)u,  a;  6  3?",u  €  ^l"" 
with  initial  condition  x{0)  =  xo,x{t)  =  xj  and  cost 

inf  /   {u,u)dt  =  It{xo,Xf) 
Jo 

Then,  /<  satisfies  the  following  triangle  inequality 

The  proof  follows  from  the  time  symmetry  of  the  cost  functional,  i.e.,  Ttixo,  ar/) 

\h{Xo,Xf). 

Consider  now  Brockett's  system 

X     =     u 

Y     =     -{x  A  u),Y  e  so{n) 
7r 
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with  boundary  conditions  a-(O)  =  x{2n)  =  0,  and  y'(0)  =  0,y(27r)  =  S,  and 
cost  /  =  Jo{u,u)dt.  Then,  we  have  that  /(5)  =  /2„((0,  0),  (0,5)),  and  the 
following  inequalities  follow  from  the  claim. 


y/(5i  +  S2)  <  /f(^+  ^/fis7),    S£so(n).  (66) 

For  a  symmetric  matrix  A  =  A* ,  we  can  also  define  the  analog  of  the 
functional  /:  Let  a{A)  =  (ai,a2,  •  • -a^),  |fli|  >  |a2|  >  •••  >  |a„|,  be  the 
spectrum  values  of  A  and  define 

According  to  [FriSl],  this  functional  is  concave  on  the  convex  set  of  nonneg- 
ative  matrices. 

Corollary  3.1   If  c,  =  i,  then  the  following  inequality  holds 


\lf[A^^A2)<  \fhAi)  ^  \[hM) 
Proof:  Associate  with  Ai  the  following  skew-symmetric  matrix 

Sr- 


0       A, 
-A,      0 


and  apply  inequality  (66).  LJ 

In  what  follows  we  will  give  a  control  system  model  of  Proposition  3.3. 
Let 

A-:X2[0,1]-X2[0,1] 

be  a  bounded  linear  operator,  and  suppose  that 

oc     -. 

K-ir  =  J2-^'l^^l  X-  eL2[o,i] 

where  ||a;f||  =  l,x'^  ±  x'^  if  (^,^•)  ^  {j,l)  and  c;  >  e  >  0.  Therefore, 
{K  -  ir){v)  =  y2-x]{v,x^)  -  xl{v,x]),v  e  L,[0,l] 

Ci 
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U  u  =  {ui-  ■  ■  -Ujn)     is  a.  vector- valued  function,  we  then  define 

K{u)  =  iK{u,),---K(u^)f 
Consider  nonlinear  control  problem  for  the  following  system 


y 


=  lj2A,u,\Ku,ye^"'  (67) 


with  boundary  condition  j^(l)  —  1/(0)  =  6  and  cost  to  be  minimized 

t  /    (u,  u)dt. 
Jo 


min 


It  is  possible  to  show  that  an  optimal  solution  of  the  above  system  has  to 
satisfy 

oo 
t.(0=E^'>n(0  +  A'^^(0 


n=l 

oo 


1 

2/(l)-y(0)  =  Z)^-(A'^AA'2), 


where  D  :  so{n)  — ►  Si""  is  the  same  operator  as  defined  in  (61).  We  will  call 
systems  of  this  kind  integral  nonholonomic  systems,  in  contrast  to  the  usual 
differential  nonholonomic  systems. 

This  problem  can  be  solved  using  previous  results,  and  also  note  that 
system  (67)  is  controllable  if  and  only  if 

max    min    Rank(5)  <  Rank(A'  -  A"). 
ve»'"  D[S)=y  ^    '  ~ 
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